Discreteness criterion in SL(2,C) by a test map 
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'^ , Abstract In the paper (Osaka J. Math. 46: 403-409, 2009), Yang conjectured that a non- 

^^ I elementary subgroup G of SL{2, C) containing elliptic elements is discrete if for each elliptic element 
g E G the group (/, g) is discrete, where / G SL{2, C) is a test map which is loxodromic or elliptic. The 

'""'. purpose of this paper is to give an afhrmative answer to this question. 
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L^; 1 Introduction 

'Tj I The discreteness of Mobius groups is a fundamental problem, which has been discussed by many authors. 

QQ ■ In 1976, J0rgensen established the following discreteness criterion by using the well-known J0rgensen's 

t^^ . inequality |9|. 

in ■ 

en ' Theorem J. A non- elementary subgroup G of Mobius transformations acting on C is discrete if and 

l/^ ■ only if for each pair of elements f,g £ G, the group {f,g) is discrete. 

^^ , This result shows that the discreteness of a non-elementary Mobius group depends on the information 

^__^ I of all its rank two subgroups. The above result has been generalized by many authors by using information 

L^ ' of partial rank two subgroups. For example, Gilman[5] and Isochenko [8] used each pair of loxodromic 

• ^H . elements, Tukia and Wang [TT] used each pair of elliptic elements. 
r> I Sullivan |10j showed that a non-elementary and non-discrete subgroup is either dense in SL{2,C) or 

C^ ■ conjugate to a dense subgroup of 5L(2,R). This result gives an approach to studying the discreteness 



of Mobius groups from the topological aspect. Mainly using Sullivan's result, Yang [12] obtained some 
generalizations by the information of the remaining four kinds of rank two subgroups. 

Recently, Chen [3] proposed to use a fixed Mobius transformation as a test map to test the discreteness 
of a given Mobius group. His result suggests that the discreteness is not a totally interior affair of the 
involved group and provides a new point of view to the discreteness problem. Yang [13] generalized some 
results by test maps (see Theorems 2.4-2.7) and proposed the following conjecture. 

Conjecture 1.1. Let G be a non- elementary subgroup of SL{2,C) containing elliptic elements and f 
a loxodromic (resp. an elliptic) transformation. If for each elliptic element g G G the group (/, g) is 
discrete, then G is discrete. 
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Yang proved the above conjecture for the fohowmg two special cases ( Theorems 2.9, 2.11 in [13j). 

Theorem Yl. Let G be a non- elementary subgroup of SL{2,M.) containing elliptic elements and f 
a loxodromic (resp. an elliptic) transformation. If for each elliptic element g £ G the group (/, g) is 
discrete, then G is discrete. 

Theorem Y2. Let G be a non- elementary subgroup of SL{2,C) containing elliptic elements and f a 
loxodromic (resp. an elliptic) transformation with |tr^(/) — 4| < 1. If for each elliptic element g G G the 
group (/, g) is discrete, then G is discrete. 

In SL(2,M.), since the trace is real, one can find a sequence {gn} of distinct elliptic elements in G 
such that gn — )• I. In fact, this is a special case ( i.e. dimM{G) = 2) of [H Corollary 4.5.3]. Yang mainly 
used this fact to prove Theorem Yl. 

While in SL{2, C), Greenberg [7j gave an example such that G is a loxodromic group and is not discrete 
with dimM{G) = 3. This example indicates that it is nontrivial to construct a subgroup generated by 
/ and an elliptic element in G which is non-elementary, in which one can apply J0rgensen' inequality to 
obtain a contradiction. 

We mention that Theorem Y2 is true but there is a gap in the proof of Theorem Y2. The author got 
a b 



an elliptic element 9 = [ , 1 with 6 / / c and 

Taking /3 = -g^, the author mistook the second entry of hgh^^ for zero. In fact, 

/ a+d (a+df-A \ 

If the sequence {hn} in G converges to h, then the product bnCn of the second and third entries of hngh~^ 
converges to — — j which is not zero for g being elliptic. 

We can mend the the proof of Theorem Y2 as followings. 

The proof of Theorem Y2. Suppose that G is not discrete. 

If G is a dense subgroup in SL{2,M) then as reasoning in Theorem Yl, we can get the result. 

If G is dense in SL{2, C), we can solve the following equation 

-cz^ + {d-a)z + b = {) (1) 

to get a solution /3. Construct /i = ( r, -, ) with this obtained /3. Let {/i„} be a sequence in G converges 

to h and gn = hngh"^ = ( " j" ) • Then 6„c„ — )• and (/, gn) is discrete and non-elementary for 
large n. This contradicts the J0rgensen's inequality 



\triff - 4| + \tr[f,gn] - 2| = (1 + |6nC„|)|r - ^ > 1. 

r 



The proof is complete. 



Let g = { I be an elliptic element and / = I „ i ) be a loxodromic or an elliptic element. 



Then 



\tr{gf - 4| + \tr[g, f]-2\=4-{a + df + \bc\\r - -\\ (2) 



Suppose G is dense in SL{2, C) and non-elementary. If we can find an elliptic element 9 = [ , ) € G 

with 4 — (a + d)^ < 1, then as in the above proof, we can get a sequence {gn} of distinct elliptic elements 
with |6„c„| —7- 0. This may provide us a desired contradiction to prove Conjecture I l.li Motivated by this 
observation, we manage to get such an elliptic element under certain condition by embedding SL{2, C) 
into U{1,1;M). 

Our main theorem is 

Theorem 1.1. Coniecture M.lM s positive. 

2 The unitary group and embedding principle 

In this section, we will recall some facts about quaternion and the quaternionic hyperbolic geometry. 
The reader is referred to [H [21 H] for more information. 

Let H denote the division ring of real quaternions. Elements of H have the form q = qi+q2\+q^+qi^ G 
H where gj G M and 

i2=j2=k2 = ijk=-l. 

Let g = gi — 921 — 93J — (?4k be the conjugate of g, and 



1^1 = ^/qq = \/ql + qi + qi + ql 

be the modulus of q. We define ^{q) = {q + q)/2 to be the reai part of g, and 9(g) = {q — g)/2 to be the 
imaginary part of q. Also q~^ = g|g|~^ is the inverse of q. We remark that for a complex number c, we 
have jc = cj. 

Let H^'^ be the vector space of dimension 2 over H with the unitary structure defined by the Hermitian 
form 

(z, w) = W* Jz = WlZi — W2Z2, 

where z and w are the column vectors in M.^'^ with entries (21,^2) and {wi,W2) respectively, •* denotes 
the conjugate transpose and J is the Hermitian matrix 

-^ ~\0 -1 
We define a unitary transformation g to be an automorphism H^'^, that is, a linear bijection such that 

(^(z), ^(w)) = (z, w) (3) 

for all z and w in H^'^. We denote the group of all unitary transformations by U(l, 1;EI). 
Following [4, Section 2], let 

1/0 = {z G tf '^ - {0} : (z, z) = 0}, y_ = |z G M^^^ : (z, z) < o}. 

It is obvious that Vq and V- are invariant under U(l, 1;]HI). We define V^ to be V^ = V^ U Vq. Let 
P : y^ — )• P{V^) C H be the projection map defined by 



We define B = P(VL), the ball model of 1-dimensional quaternionic hyperbolic space. It is easy to see 
that IB can be identified with the quaternionic unit ball {zGH: |2;|<1}. Also the unit sphere in EI is 

dM = P{Vo) and the center of the bah is = P K 

li g = i J ) ^ U(l, 1; H) then, by definition, g preserves the Hermitian form. Hence 

w* Jz = (z, w) = {gz, gw) = w*g*Jgz 

for all z and w in V. Letting z and w vary over a basis for V we see that J = g* Jg. From this we find 
g-^ = J-''g*J. That is: 

a b\ fa —c 



d) \-b d 

and consequently, 

\a\ = |(i|, |6| = |c|, \a\ — \c\ =1, ah = cd, ac = bd. (4) 

As in [Il[2]) we can regard U{1, 1;IHI) as the isometrics of real hyperbolic 4-space, whose model is the 
unit ball in the quaternions H. SL{2,C), the isometrics of real hyperbolic 3-space, can be embedded as 
a subgroup of U{1, 1;M) as following: 



where 



f e SL{2,C) -^ TfT^^ eu{i,i;m), 



-( ' -' 



Let / = ( " M G 5L(2,C). Then 

We mention that our model is slight different from the model in [1], where the Hermitian matrix is 

J = I 1 ) • -'^^ follows from ([3|) that both models define the same unitary group. This difference just 

exchanges the inner and outer of the same unit sphere of those two models. 
The following lemma is crucial to us. 

Lemma 2.1. (cf. Q Corollary 4-5-2]) Let G be a subgroup of U{l,n;M) such that (a) G does not 
leave invariant a point in dH^ or a proper totally geodesic submanifold of H^ (h) the identity is not an 
accumulation point of the elliptic elements in G. Then G is discrete. 

Using the same notation as in [4J, for any totally geodesic submanifold M £ H^, we denote by I{M) 
the subgroup of C/(l, n; H) which leaves M invariant. By [U Proposition 2.5.1], the proper totally geodesic 
submanifolds of H^ are equivalent to one of the four types: H^, H^ and ^^(I). 

By U Lemmas 4.2.1,2], we have the following lemma. 

Lemma 2.2. Let g e U{l,l;M). Then 

(i) the elements g G I{H^) cli"^ of the form 

g = AX, AG Uil, 1;M), A G M, |A| = 1; 



(ii)the elements g G liH^) are of the form 

g = A,AGUil,l;Cy, 
(in) the elements g G I{H^{I)) are of the form 

Lemma 2.3. Let G be a subgroup of SL{2,C). Then TGT^^ is a subgroup of C/(1,1;EI). If g = 

" ^ j G G and TGT-^ C I{H^{1)) then either 

(i) a, d G M and b,c €z iR, or 
(a) a,d £ iR and 6, c G M. 

Proof. If 5 = ( " M G G and TGT'^ C HH^I)), then TgT'^ is of form (p. By our embedding 

and the fact jc = cj,Vc G C, we can verify that the cases e = 1 and e = —1 correspond to cases (i) and 
(ii), respectively. 

Lemma 2.4. Let G be a subgroup of U{1, 1; H). Define tr{g) = a + d for g = [ , ) G G. Then 

mr{9)) = mr{fgf~')),yf e ^(i, i; H). 
3 The proof of Theorem 11.11 

We also need the following lemma, which is a direct consequence of the well-known proposition in [10^ 
Section 1]. 

Lemma 3.1. Let G be a non- elementary subgroup of SL{2,C). Then either 
(i) G is discrete, or 
(ii) G is dense in SL{2,C), or 
(Hi) G is conjugate to a dense group o/S'L(2,M). 

The proof of Theorem ll.lL Suppose that G is non-elementary and not discrete. If G is conjugate 
to a dense group of SL{2,M) then we can obtain the result as in Theorem Yl. 

In what follows, we assume that G is dense in 5L(2,C). 

By our embedding, Gi = TGT~^ is a non-elementary and non-discrete subgroup of C/(l, 1;IH[). Let 
M{Gi) be the smallest totally geodesic submanifold which is invariant under Gi. By [Jl Lemma 4.5.1], 
the limit set L{Gi) of Gi belongs to dM(Gi). Normalize such that M(Gi) contains (abuse of notation, 
still denote this normalized subgroup by Gi), then M(Gi) is one of the four types: H^, H^, H^(X) ^-nd 

Since TGT-'^ is non-elementary, M(Gi) / H^. Suppose that M(Gi) = iJ^. By Lemma[221 TGT'^ 
is a subgroup of C/(1,1;C). Since PC/(1,1;C) is isomorphism to P5L(2,M), we can get the result as in 
Theorem Yl in this case. 

Suppose that M(Gi) = H^. By Lemma [2.11 the identity is an accumulation point of the elliptic 
elements in Gi. Therefore we get a sequence {gn} of distinct elliptic elements in G such that gn — >■ T 
By the same reasoning as in Theorem Yl, we can get the result. 

Suppose that M(Gi) = H^{i)- By Lemmas 12.31 12. 4| we know that the trace of ^f G G belongs 
to either M or iM. Let k G SL{2,C) be an elliptic element with 3.1 < tr'^{k) < 3.9. Since G is 



dense in 5L(2,C), there exist a sequence /c„ converges to k. Therefore we can find an elhptic element 
9 = \ ri I ^ SL{2,C) with 3 < tr^{g) < 4. Since G is non-elementary, we can further assume that 

6 / / c. 

Let /3 be a solution to the equation ([T]). Construct ^ = I J and let {/i„} be a sequence in G 

converges to h. Then gn = hngh~^ = 1 " j" ) ^^^ elliptic elements with 3 < tr'^{gn) = tf'^ig) < 4 

and bnCn — )■ as n — )• oo. Note that {f,gn) is discrete and non-elementary for large n. This contradicts 
the J0rgensen's inequality 

Mgn? - 4| + \tr[gn, /] - 2| = 4 - (o„ + drf + |6„c„||r - -^ > 1 (6) 

r 

The proof is complete. 

Remark. In [13], Yang asked that whether there is a non-elementary and nondiscrete subgroup of 
Isom{H^) = PSL{2,C) which contains elliptic such that each of them has order 2. By the proof of 
Theorem ll.il we know that the answer to this question is negative. 
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